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This study was 'directed towards developing aicrofiche 
oncepts and aiclrcfiche production aethods to, c^^ture the 
■ediuB fpr the delivery, of both text and illustrations- 
ntraxt of the Advanced Instructional Systea (AIS) — a 
c^BPUter basely aulti-«edia-, self-paced iastructional prograa of the 
i;ir Training Coaaand at Lotry IFB, Colorado, Specific applications 
wfete'd)' the conversion of color intensive audiovisual aodules ta 
liictofiche; <2> the foraattjinq of the aicrofitbe to deliver both 
^j:f«arf and alttenative track* aodules ih an integrated aulti-track 
KOdulev and ('|V the use of aicrofiche in' testing and test control- A 
piiJMirt consideration was ^he inyestigatipn of coBputer output 
iticrofiche fCOM) ^iechnology as a aeans of authoringt revising, and 
liainaging instructional aaterials. ,A aicro fiche systea was designed, 
tttiiizing existing a:^s coaputer , resources, which satisfied 
adainistratife as well as instructional requireaents. Applications* 
^ere then developed in which specific >IS lessons were foraatted for 
i|Ulti-tracJc# ^olor intensive presentation ^on liorofiche- In addition, 
^look tests were produced^ using COH production technigueiv^^ 8ase4 on 
c^assrooB/^valua'tion^, results suggest that the Dual-Tiche^concept 
Charts a<Wth that proaises to be a cost-effective alternative to 
existing AIS instructional aedia, as well as a aeans of routinely 
^Ipdating and revising instructional aodules that coablne text and 
graphics* Appendices contain questionnaires used for iapleientation 
fiiedback. Uuthor/CSV) 
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Item 20 Continued: 

« 

of authoring, revising, and managing instructional materials. A microfiche system was designed, utilizing existing AIS 
computer resources, which satisikd administrative as as instructional requirements. The system is calQed the 
dUal-fiche concept and provides a way to separate th»production of the text component of an instructional module 
from the production of the graphics component, combining the two typ^ of information at the point of use -the 
microfiche reader. This development brings the power of COM to bear dkectly on tlie problems of updating and 
revi^g in&tnicticmal nt^teriki ^idiile gaining the flexibility n^essary to produce graphics (particularly 
color-intensivB grapliics) consistent with <x)ntent formatting requirements. The concept involves two transparencies 
(one with text and the other with graphics) which are projected simultaneously. 

Apprtcations were then developed in which specific AiS lessons were formatted fm mUti-track, color intensive 
presentation on microfiche. In addition,' block tests wo-e produced also using COM production techniques. 
Classroom trials were conducted and the microfiche systems wG^e evaluated. / 

* * k ' S ' 

The Dual-Fiche concept charts a path that promises to be a cost-effecti^ alternative to existing AIS 
instrticUonal media and promises the additional benefit of routine update and revisi<Hi of instructional modules that 
combine text and graphics. . 
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SUMMARY 



The feasibility of using microfiche as an alternative medium for 
the'delivery of technical training has been investigated. The objective 
of this stu<^ was to develop aiicrofiqhe formats for selected types of 
instructional iaateriaU, ,to produce the materials utilizing the formats 
developed, to conduct student tibials of the microfiche in courses cur- 
rently asing the Advanced Instruct! ofial Systecu (AIS), and to determine 
the ' optimal approach for continuing to^build the microfiche capability 
within the AIS. , . - 



Backi 



ground 



The AIS media subsystem utilizes "alternative track" instructional 
nodules that rely heavily on illustrations, either photographs or graph- 
ic renderings. These modules are presently delivered by audiovisual 
media. Illustrated. Texts, and video systems. Where large learning cen- 
ters are involved, these meiterials accumulate and create administrative 
burdens that could be addressed if the microfiche were adapted to the 
learning en vironBffint. The applications envisioned were: (1) the con- 
version of cojor intensive AV modules to microfiche; (2) the formatting 
of the microfiche to deliver both primary and alternative track modules 
in an integnated "multi-track" module, and (3) the use of microfiche in 
testing and t^st control as well as a primary Instructional medium. 

'''^'^e: microfiche medium offers proven advantages in the management, 
storage, and retrieval of information, and it has potential cost advan- 
tages. The stucly was directed* toward developing microfiche formatting 
concepts and fliicrofiche production methods to capture the power of tht 
medium for delivery of both text and illustrations in an instructional 
environment. 

• * 

Approach 

The approach taken was to device a^mlcrofiche system that met 
administrative and g^oduction criteria; classroom trials were conducted 
to determine if the system met student use criteria. The system is 
called the Dual-Fiche concept. The Dual-Fiche concept provides a way to 
separate the production of the text component of an instructional module 
from the production, of the graphics component, and yet comb.ine'or merge 
the two types of information at the point bf use — ^e microfiche reader. 
The purpose of this development was to tring tHa. power of Computer 
Output Microfilm (COM) to bear directly on 'the probrems of updating and 
revising instructional materials while gaining the flexibility necessary 
to^ produce graphics (particuUrly color-intensive graphics) consistent 
with content formatting requirements-. "^The' concept should be understood 
as involving twojtonsparencies, one with text and the other with graph- 
ics. Imaiges fror^ each transparency are projected simultaneously, much 
as is dorie with complex viewgraphs having registered overlays that are 
projected together. 

/ 
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Prototype developinent confirmed the feasibility of the Dual-Fiche 
concept. Applications were then develo|\ed in' which nine lessons on 
Bagic Soldering Techniques we**'e formatted for lauUi-track, color inten- 
sive presentation on microfiche. In .addition, block tests were produced 
also^ using the COM production techniques.' Classroora trials were con- 
ducted" and t{ie laicrdfifihe sys tens were evaluated. The nine lessons were 
prepared jn two different versions in order to gain experience with 
different raicrofiche .fdrwatting techniques. The techniques were asso- 
ciated with different costs 6f production a and they demons'treted basic . 
principles that affect the way text and graphics can be integrated on- 
Biicrofiche. . , ^ 



Results and Conclusions 

This study engaged, the famijy of issues that surround the develpp- 
ment of microfiche as an instructional medium. The development of the 
Dual-Flche concept charts a path that promises t6 be a cost-effective 

.alternative to audiovisual media and it promises the additional benefit 
of ^routine update and revision of instructional modules that combine 
text and graphics. No serious problems were encountered in the class- 
room trials and it appears that student acceptance of the medium is 
hiigh. Further deveTopment of the concept is recommended but such devel-^ 
opment should take place in a training environment where significant 
administrative values accrue because of the need to update or revise 

instructional materials. Testing applications are obvious candidates. 
The optimal path is one 'Sii which further developments are -routinely 
incorporated In a course of instruction, evaluated, and new developments 
incorporated in an iterative fashion. 
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I. INTRODUCTION 



• ft 

IiapleiBentation of the Advanced Instructional System (AIS) called 
for the use of a broad range of instructional media, some traditional, 
sQiae innovative,' but all designed to cowpleroent individualized, self- 
paced, cooputer-»anaged training. The AIS is a prototype system merging 
coj^uter technology and Media developtaent for the administration and 
manageaient of individualized technical training on a large scale. It is 
within the fra»e)«(ork of this systea development that the feasibility of 
using fflicrofiche as an alternative mediuia for the delivery of instruc-" 
ti on has been investigated.' . ^ 

Interest in the potential of fljicroforra, specifically microfiche, as 
an instructional raediu® sterns from two considerations: (1) the medium 

,.has proven advantages in the management, storage, and retrieval of 
Inforsiation, and (2) the medium promises significant cost advantages 
when it. is compared with other media. The problem addressed in this 
r§^ar<:h was to determine when and how the proven and potential advan- 
tages of the microfiche could be realized in an instructional environ- 
■ent— the AIS environment as a practical case in point. The microfiche 
nediun is an attractive option for a host of admitxi strati ve reasons, but 

"the feasibility of microfiche. in instructional applications must finally 
be assessed in terms of its contribution to technical training objec- 
tives. . 1 

The objective of this stucjy was to determine the feasibility of 
using innovative microfiche formats for selected types of instructional 
aaterials, to produce the materials utilizing the formats developed, to 
conduct student trials of the microfiche - in an ongoing AIS environment, 
and to determine the optimal avenue for a continued microfiche capa- 
bility within the AIS at Lowry AFB. . * 

Background - 

AIS instructional modules (some 500 in number supporting four 
courses representing three Air Force career specialities) are classified 
as either primary or alternate track in nature. In most AIS courses, 
the primary track is a print medium. Alternate track modul-es ^are de- 
signed to meet ythe-same lesson obje'ctives as the primary track and can 
be delivered yoy audiovisual media, Illustrated lA>»ts,* or a-l ternate 
forms of print media. Alt&fnate modules are further delineated -by 
distinctions of "media overlap" or ' "multi-tracking. "■ Media • overlap 
constitutes adaptation to another instructional medium with only thbfre 
changes necessary for the adaptation tcT the new medium in evidence. 
Multi -tracking impl ies a major restructuring of the content to meet a 
particular instructional strategy, difficulty leVel , or* approach. These 
"aulti-tra^jking" and "media overlap" modules were considered by the Air 
' •■ ' ---^ 

"Illustrated Texts, pictured in Figure 1, make Intensive use of 
illustrations in a book format; the intensive use of illustrations is 
characteristic of AIS alternative track modules. 
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Fo^ce Human- Resources Laboratory (AFHRL) to be potential candidates for 
aicrofiche impleB^ntation, along ^ith certain progression testing appli- 
cations. ' ' 

. I ■ ' • • , : . : 

V In planning for this study, AFHRL also considered the potential 
utility of Computer Output Hicrofiche (COM). This technology could link 
the co^uter-based lesson development 'capabilities Inherent in the AIS 
with the direct production of course materials on microfiche. While the 
limited graphics, capability of the COM Impose constraints on its use for 
AIS instructional modules, student-testing applications were thought to 
* be practical. ^ 

Further, it was, thought that the microficHP might be a cost- 
fffective substitute for prenarrated filmstrips if soijie way could be 
found to acc(»wodate the proWem of mergtng text and illustrations.- An 
effective merger woul if be difficult because the microfiche technology 
has evolved with emphasis on data -and* documentation character! st1^:s; 
hence,' microfiche with the. negative image polarity and high Information 
density is found .in the printed^ext elements. The film-based component 
of instructional media, on the other hand, has%volved with emphasis on 
the characteristics of the visual content; hence, filrastrips • and slide 
presentations with color illustrations with low information density are 
together with printed text elements. 

A research agenda formulated from 'these speculations was focused on 
specific AIS applications: 

.1. The use of microfiche formats in structuring multiple level 
4 " (fflulti -track) instructional Tsaterials 

. ■ • ■ . /I ' 

The use of COM for the generation and control of tests' and 
test i^ms ^ . 

The use of , col or microfiche as a substitute for traditional 
prenarrated sound-slide or filmstrip formats. 

This agenda *was used to guide the investigation reported here and to 
ensure that the feasibility of microfiche applications within the AIS 
framework was broadly examined. 

Principal Phases in the Study 

The i^dy began with an assessment of the characteristics of AIS 
1 nstructioflal materials and the AIS environment. Preliminary plans were 
developed for implementation of the microfidie products , including 
equipment acquisition. The Dual-Fiche concept for merging color illus- 
trations and COM-generatfld text was formulated during this phase and the 
preliminary development of the concept was completed, including .verifi- 
cation of the technical feasibility for fiche production. Section II of 
the report discusses this phase of the study. 

The. second phase of the study- involved the development of^ateMals 
for testing applications and for cl^s^sroom trials. A performance- 
oriented block of Instruction was selected for the classriSom trials, and 
two versions of the instructional content were developed. This phase 
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Included the development o/yf1che formatting concepts that engaged basic 
issues involved in thft presentation of color-i.ntens^ive illustratloijs and 
text (Section III). \_y ^ 

• - « 

CTas^roMi "iJi^lepjentatlon constituted the third phase of thfe study, 
^nd the results of"fhese triaTs#re considered! to demonstrate the, feasi- 
bility of COM-generated Bi4croficJie applications ii»i)o4h testifig appli- 
cations and as an integral part 4)f the Dual-^che concept for the deViv- 
ery of. ciolor Intens-We, »uTti-track instructional modules (Section IV). 

Recownendatlons 

As will be seen in the discussion presented in this report, each 
'phase of work was disciplined by a concern with how tech!iii;al^ai.ning 
could be enhanced through further development of micHfilm applications. 
These considerations were the driving .force behind the formulation of 
the Dual -Fi Che concept and the attention given, to integration of. pro- 
duction techniques into the capabilities of the AIS and the Air Force 
training systeas flwre gerterally. Recpainiendatlons for further develop- 
^nt "are presented in Section V, along with informatioh concerning the 
cost-effectiveness of microfiche applidftt ions. 



II. DEVELOPMENT OF THE ^UAL-FJCHE CONCEPT ^'■^ Cj 

.The Initial effort niade in this study wa^ to conducj and document 
a .feasibility survey \rfithin the existing AIS program to determi^ne op- 
tionar. applications areas for microfiche impTeinentation and to 
the seiectioo of viewing equipment. The fotir courses of instjFuction' 
^ei^loyitig'the AIS .were analyzed in an effort to^estabjish criteti* for 
*siBlectir^^artfcufair application areas.*' - , , ' 

^ - ■. • 

,^ The purpose of the survey* can be clarified by exaipining Figure 2. 

where a flowchart showing the steps required to prepare and produc* AI§ 

materials is presented. .The shadetl .area on the chart irepresents th^ 

scope, actions, .and liraitati^ons of the overall ijtudy wjien coffiparNTto 

^tfl^ technical, arid manageiaent requirements for introducing courseware on 

a laVge sqale. This pecspective is important because it demonstrates 

tbe context in whic^ the results of the study must be evaluated. 

Results , of the Feasibility Survey ' 

Th§ sur-vey effort restilted in the incorporation of adniinistratfve 
criteria, along with criteria related to the use of instructional mod-, 
i/l6s. As "a practical matter, it was apparent, that the applicattons* 
chosen %Ko|Jld.be limited to stabl^ falocks of instruction, at least for 
the duration of the study. . it was found thtt stability coy Id be, guaran- 
teed only for a limited nqmber of ATS modules.' The transition of AISv 
from a. research. project to an. operational' system within the Air Training 
toinmand (ATC) Was planned for JariuaVy 1978, and curriculum revisions- 
were gener.ally eknticipated In. each of the AIS -courses. To make. matters 
somewhat easier, it was found that -alternate track AIS modules were 
'generally of the saare length and'of consistent format (e.g., Illustrated 
Texts from different blocks wer^ similar), with no distiTiguishlng char- 
acteristics that might influence thg selection of application 'area 
except 'for content. - , ' - 

The initial Impression that access to stable blocks^ of instruction 
might be more • impo'rt^nt as a selftcttsBk* criterion^^tha^j^tH^ character- 
istics of the existing Instructional modules, wa^ reinforced .^^en the 
contents of particular modules were studied. These modules wS^e ana- 
lyzed at the suggestion of coufse personnel on the as sump tj^ ^that they 
T^epresented -stable blocks of instruction and that, if^ "t|jK)|icV&f.i<:he 
"conversions" were successful, the converted raateVials might be used 
routinely, after a period of classroom evaluation. ' "* . 

Th^" -analysis indicated that conversion of the modules eould be 
approached on a rather straightforward basis if the module was con- 
sidered to stand alone*. For example: The Illustrated Script is a bird 

" ''The four courses fn which the AIS was ' implemented at Lowry :AFB 
were Inventory Management (IM), Materiel FaclVities (MF), Precision 
Meastjring Equipment (PME), and Weapons^lechanic <WM). The V/M course was 
redesignated Aircraft Armament Systems' Technician in 1978. 
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Figure 2* 

^•AIS Lesson Authoring and Production Cycle de^^lo/ed by McDonnell Douglas Austronautics Company 
Ast foT^'Use in the Advance Instructional System. 
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copy version of " the narrated filmstrip. Three illustrations froffl the 
fiTiBStrip are fortuatted along the left-hand side of a page and the 
associated narratfon iff, printed to the rjght of each picture. A stan- 
dard 98 inage sicrofich^ could be used to reproduce a sinilar format In 
color, perhaps organized by column rather than row in order to better 
-capture the sequential nature of the instruction. 

\ A similar approach cou^ be taken with the Illustrated Texts. The 
standard 63 ima'ge COM' microfiche could be us^d to repro(iuca the Illvs- 
trated Text in a two-pages-at-a-tiae format. . Such approaches were 
considered t^be trivial. Even though each approach could be re^fined, 
the prdbries that cenains is how to integrate the oiicrofiche nodules into 
a blapk qf instruction. . ' ' " 

. Further exanination of these selected blocks of instruction demon- 
strated that different patterns in the implementation of the microfjche 
could be expected as a result of the different- approaches taken In the 
design and selection of the AIS materials for particular blocks of* 
instruction.' For example, in Block 8, Lesson 8 (PME)^ the multi- 
tracking concept was iwplenented through the use of di fferent coitbi na- 
tions of the alternative track modules in conjunction with programmed 
texts (the primary "track) .and Technical Orders (TOs). Each combination 
(there were four possible) suggested a different microfiche formatting 
concept. Each of the other blocks had equally complex but different 
patterns in the way the lesson modules were implemented. In Block 6 
(WM), the six-AIS lessons employed either programmed texts or ajJdio- 
visual (AV) modules as the primary track, each used in conjunction with 
an appropriate TO. The AV modules were reserved for performance- 
oriented training and this "use environment" clearly 'di<:tated t^e AV 
choice. The problem in terms of implementing ,the microfiche applica- 
tions appeared to be one of finding a conmon denominator so that a 
single hardware system (with some variations^ could be designed to enjoy 
wide applicability with AIS. 

' The common denomiinator emerged in a surprising, way. A basic diffi- 
culty with instructional modules (and training materials more generally) 
is updating or modifying contents ifi response to changing environments, 
both i'nternal and external to a training school. The need for basic 
.improvement in the ability to incorporate changes ^was dramatized by the 
AIS tralffisition, but the underlying need' was manifest dLpwtfg th^ process 
of identifying stable c'andidate blocks and lessons for microfiche imple- 
mentation. Thus, it became apparent that one of-- the Criteria for pur- 
suing the microftche application should be easp of updating tbe contents 
of instructional modules. ^ This realizati^ led to the decision to 
employ computer output microfilm as th^/#eans f^r pfocTucinf .all text 
portions of AIS modules as well as for tne production of test itelns (one 
of the specified application areas for this investigation). 

This decision introduced a new challenge, that of finding a way to 
incorporate graphics, including' color illustrations and flat art, with 
the COM-prbduced «iicrofiche. This challenge stimulated' the development 
of a concept for inerging information recorded on separate microfiche. 



The DuaT-Fiche Concept ' * 

The Dual-Flche ji^ffcept envisionedVa systert of fiche production that 
would use a COM-prodUced positive microfiche to deliver the' text portion 
of an instructionaV fflodule and a color alcroffcha to deliver the'graphic 
pdrtlort of the instruction. ' By placing the text and the graphics in 
reserved areas oh each film, it appeared possible to merge the text and 
graphics using the projection syste* of the reader. Merging of the te^t 
and graphics appeared to involve only the careful registration of the 
tw<l fiche while placing the ' respective filins fn emulsion-to-eflmlsion 
contact, rt was thought that a custonj^niade, clear plastic envelope 
could provide the necessary registration while helping to keep the 
si crofichte clean, , 

- . sr^ - . ■ . 

The concept had unique advantages when examined in light of the 
results obtained froffi the survey of application, areas. For example, 
updating the text portion of the sicrofiche could- be done without repro- 
cessing any of the graphics! The COM fiche that has outdated info r- 
aation is siaply disposed of and a new COM revision packaged with the 
fiche containing the graphics. In this way, the high unit cost coapo- . 
nent of the module, e.g., the jtolor graphics, can be reused while the 
low unit cost coi^nent can be replaced as needed. Some of the other 
advantages Include: 

1, The basic concept'could be adopted for producing multi-track 
Bodules, tests and test iteras, and AV conversions. 

• • ' ' * , ' ■ , ' - 

' 2. A single systefii integrating fiche production and microfiche 
viewing equlpraerjt was established. This advance made it 
, possible to select microfiche readers for the implementation 

trials accordihg to system specifications. 

■ " - . » 

3. The power ef the mdin-frame computer supporting the AIS could 
be brought to bear on the development and production of course- 
ware. (This^potential - makes it practical to talk about up- 
dating courseware by directly linking the editorial and lesson 
d6velopment* function, which resides in the technical school, 
' with the means for producing courseware.) 

With the concept 1n harid, attention was turned to developing CQM , 
production techniques and graphics capability. Prototypes of the Dual- 
Fiche were developed for a multi-track lesson, a block test that includ- 
ed simple diagrams and an AV conversion. The principal problems encoun- 
tered and their solutions are discussed in the following paragraphs. 

COM Production . ^ ' ^ 

The coinputer' system at the University of, Denvj^r was used to develop 
prototype production techniques. While the system had limited 'word 
processing" capability., software was developed so that edited text could 
be ordered and reordered as a part of the fiche formatting process. 
Documentation packages of the procedures end the requirement* for pro- 
ducing a Printer Backup Tape suitable for producing the microfiche at a 
local COM service bureau were devs^^n. As this pha^^;was completed,- 
AFHRL developed the software, necessary /for. the prbduct'ton of Printer, 



Backup Tapes and installed additional editing routines in conjunction 
with the source program editor (SPE-) used with the AIS computer (Control 
Data Corporation Cyber- 73t 16)^ These changes made it possible to shift 
the produciion th.e micrpflCTe developed for classroom iroplementation 
during Phase 2 f rocs the University of Denver to the AIS computer system 
at Lowry AFB. 

Color Microfiche Production ^ 

■ t 

Various production opt^ions were evaluated in an attempt to discover 
the *pract1<i^l problems associated ^ with color iBicrofiche. A site visit 
tto the ^astman Kodak Coapany laboratory ^t Rochester, New York, made it 
* clear that the festrictions imposed by commercial production, of color 
fiche would not give the desired flexibility in roicrofiehe formats 
thought to be needed if, for example, multl -track 'formats were to be 
nade. These restrictions were seen as defining the format for the 
Dual-Flche, and this was not satisfactory given the applications under 
investigation. 

Perhaps a larger problem was that the capability to produce the 
color «icrof1che would rest primarily with a second party not directly 
Involved with the development of the content of the microfiche modules. 
This was feen- as being Inconsistent with bringing the text portion of 
the instructional content under control of the coefeent specialists in 
thQ trairving schopls. As a result, techniques were developed (they are 
reviewed In the next section) which would allow an Air Force production 
„ agency to produce co>or microfiche masters that could be duplicated by 
local photographic laboratories.. ' 

Fiche Fortnatting Concepts " 

The fiche formats prototyped during the preliminary evaluation of 
the Dual -Fiche concept are summarized below. Four lessons were designed 
with the objective of coordinating between' content and production con- 
straints. One design factor thaV was >common to each format was the 
desirability of vertical formatting rather than using horizontal for- 
Bats. This factor ref'lects, the sequential nature or flow in the lesson 
content, and it cah^e best preserved by the veyttical formatting of 
information. Table 1 tabulates the factors that were accommodated in 
the design of the prototype fiche. _ - 

. Block 6 Lesson I (WM) 

Type: ' Programmed text with graphics ^ ; ' 

Style: Vertical and horizontal progression 

Format: Text and graphics on same frame. Embedded questions on 
corresponding frame, next column. Restatement of ques- 
tion and itr^er on right of frame , located on line corre- 
sponding to correct multiple choice answer. Self-test in 



last column with restateaent of question and answer to 
right of and on same lirie as correct multiple choice , 
answer. 

Block 6 Lesson 2 (W) 

Type: * Fil»strip'/tape " - \ 

Style: Vertical progression 

" . Fonsat: Text and visuals on same franie. ^se of oversized visuals 
on selected frames. Embedded questions appear on sepa- 
^ rate fraaer throughout lesson. Answers to embedded ques- 

tions located at bottom of each frarat. Self- test on last 
column with restatement' of question and answer to right 
of and on same line as correct multiple choice answer. 

Block':6 Lesgph 5 (V«) 

Type: Programmed text 

Style: Verttcal progression 



TABLE 1 

A TABULATION OF LESSON CONTENT FACTORS ACCOMMODATED BY FORMATTING 



Type, 



Programmed 
text with 
graphics , 



Example 



Text 



Graphics 



Questions 



Answers 



Self 
Test 



T 

Last 
column 



Block 6 
Lesson 1 



Appear on same frame 



J 

Separate 
column 



Right side 
of frame 



"7~ 

Last 
column 



Filmstrip/ 
tape 



Block 6 
Lesson 2 



Appear on same .frame 



Same 
column, 
separate 
frame 



~"T 

Bottom of 
frame 



Programmed 
text"n<r 
ics 



Block 6 
Lesson 5 



T 



graphil 
Test 



Block 



~~1 
Separate 

Column > 



Last 
column 



1 ^ T~ 

Appear on same frame 



V Indicates that this element appeared in the prototype microfiche. 




Test in odd numbered columns. Questions -in even numbered 
columns. Information density varies. No graphics (some 
visuals suggested). 



Block test 

Vertical progression 



Questions, multiple choice answers, and diagraas appear 
on same frame. Information density -usually low. 



EquipaerYt Selection 



As Indicated earlier, the decision ta make COM-produced microfiche 
the building block for the microfiche application^ gave specific direc- 
tions to the equipment selection process. Three models of microfiche 
readers were purchased, based on mechanical , optical , and maintaina- 
bility criteria, and they are pictured in 1 ater sections of this re-, 
port.* The iysiem was based on 24X fiche reduction to conform with one 
df the standard fich^ reduction ratios available on COM equipment. The^' 
24X ratio also coincides witlh the .maximum practical reduction that can 
be used in making satisfactory, color microfiche. The three models made 
it possible to match the aspect ratio, of the COM-produced image with thfi._ 
aspect ratio of the reader screen. The largest screen size, 11 by 14 
inches, would display a normal page of computer printout in actual size.. 
This "horizontal" aspect ratio was considered to be ideal for combining' 
text and illustrations, particularly in a side-by-si^e format. 




•v 



~ "Additional equipment, including reader-printers and portable 
microfiche units were also purchased in order to have flexibility ia 
implementing specific applicatiojjs. , ' ^ 



■I 
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III. DEVELOPMENT Of COURSE MATERIALS 



The $econd Phase of the study began with the decision to implement 
the 'color wicroflehe in Block 14 of the Weapons Mechanic course. This 
block of instruction promised to be a challenge because it was highly 
perfcrraance orientfd. It was concerned with the basic techniques for 
soldering electronic components; and with, the students using soli/ents, . 
ft ux,. solder, heat, fjlesv brushes, and ^o on, i% was clear that micro- 
fiche application' was a diffijcult one. 

The primary tracit swdyles used in this block were a groi^^f four 
Illustrated Texts covering nine instructional objectives. . The choice of 
tt\e block was the result of a series of administrative considerations 
"*Bat were related. to (a) the AIS transition protess, (b) the need for 
stability in content, (c) the advantage 'offered the project team yOf 
becowing faialliar with only one tfechnlcal subject, and (d)'the oppbr- 
tunUy to develop the inulti- track application J n conjunction with a 
color-intensive application. 

The Bjulti -track application in which the instructional content , 
available In the primary track is restructured to give the studeni an 
optional. or second path -to achieve instructional objectives was found ta 
be represfjfited in the naterials included in the TOs used in the .Block. ^ 
The TO is a manual entitled General Shop Practice Rgquirements for the / 
Repair, Maintenance, and Test of Electronic EquipmentT Materials would 
iie taken frow the Tb and Integrated with the corresponding subject 
matter presented in the primary track to achieve a complenjentary, but 
not Independent, path to reach the instructional objectives. 

The fact that the color conversion was based on a set of Illustra- 
ted Texts rather than AV presentations was not considered significant, 
the content for Illustrated Texts and AV modules' are, to a significant 
extent, interchangeable. That is, thtf audio portion of a lesson is 
typically presented as text in t-he Il/ustrated Text, while the visual 
portion is captured on 2 by 3 inch/(50. 8x76. 2nra) > color prints^ The 

• "negatives" used to produce a filmstrip can also be used to produce an 
Illustrated Text. The decision to use .the Illustrated Texts from 
Block 14 was thought to be of little consequence in terms of the overall 
study objectives, since the comparative cost picture would be developed 

* from the AIS experience with AV jnodules. , " " 

■ ■' <■ 

Two^^rsions of the Dual-Fiche ^ 

• Figure 3 presents examples of the different versions of the micro- 
fiche implemented in Block 14. The two versions represent different 
approaches 'to the problem of i^^tegrating text and graphics within an 
individual' frame or reader display field. The formats o'f the fiche are 
the same, except for the approach taken when specific student perfor-' 
nance is to be guided. (Compare the .layout patterns for Columns 4, 5, 
and 7.) ' 

12 



It should be note'd that the' microfiche developed for^Block l4 
, ifBp}e«entatioh are not the standard 4 by 6 inch ( iO 5x148. Snwi) size. The 
> standard COM fiche would have hine. columns instead of the seven shown in 
the figure. The last two columns of the standard fjchs were not used in 
this phase only because it was expedient .not to use them. The color 
fil^ that serves as one ccwjponent of the Dual-Fiche concept is available 
in precut form and in small quantities onl* in 4 by 5 inch (105 by 
127ffliB) or 5 by 7 inch (127 by 177. Saa) sheeli. ^ince this phase of the 
research was highly devel opfflental . it was attractive to work with small- 
er units of infonaation or\ each |iche\ a$ well as to minimize the cost 
of film and film processing. The small-size fiche was made by simply 
trinwing off the unused columns. 

Version I is called Progressive Sequen^ce, because the images aad . 
text are combined in the performance columns so that the' previous step 
' pictured ahd explained is always on the reader screen when the nef»^ step 
is shown. Ttie familiar "frame^ is not the building blocj^ in the PVo- 
gressive Sequence Version— rather it is the column. Version II is 
called Full Fraa^e because, and as the figures show, the frame is the 
basic building block for the information;' presented in the performance 
. columns. 

• The formats of the two versions are the same in many significant 
respects. In the example- shown, Lessons 1 and"2 are formatted in seven 
columns with identical text in each column. The number of illustrations 
is the same, the TO content' is. the same, and the structure of each les- 
son, as represented by the information in each column, is the same. In 
fact, the first raw of the fiche—called, a )dsual index to the content 
in each column— has identical information, only the way the text and 
visuals are related on the! screen H different, and this difference 
becomes significant in the performance columns 4, 5, and 7. Figure 4 
shows these differences by a side-to-side comparison of what a student 
might see on the screen. 

While the difference in visual impact due to 'color cannot be demon- 
strated because the comparisjon is in black and white, the amount of 
visual information differs- greatly, and the relationship between th6 
text and illustrations is also different. The significance of the two 
versions should be understood from two perspectives; oQe relates to. Cost 
of production, the- other perspective relates to the integration of text 

• and visuals using microfiche. An -overview of production-related con- 
siderations will be presented ftrst. \ V 

The Production Cyclej f 

-i s 

. figures shows the major steps in .producing Dual-Fiche in both 

versions. Step 1 is the familiar lesson authoring and planning activity 
associated withithe development of any instructional module. At this- 
state, the Block 14 lessons were designed according to . format rules, 
such as thfe organt2atiofV-©f-4«Ssoh elements by column and the use -of the 
visual indejS^, in Row 1. The fiche shewn in Figure 3 are organized so 
that generar TO information ii^ included in column ,1, and tools and 
equipment for all lessons are shown in column 2, plus specific TO infor^ 
«atipn related to equipment items. Column 3 int^.oduces the first lesson 
with a -picture of an unformed soldering tip. A list of equipment items 

O r. 
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PflSDOUCTKH* CYCLE FOR T^E EXPERIMENTAL DUAL MICROFiCHE 



Q STARTING WITH THE CONTENT OF THE LESSON 
TO BE a)NVERTO>- • ESTABLISH THE GENERAL 
RCHE STRUCTURE. i.i.,(>RGANIZE LESSON 
^ELEMENTS BY COLUMN, INTEGRATE T 0 
MATERIALS, PLANTHE VISUAL INDEX. 



PREPARE (X)MPLETE STORYpOARD 



E_ 



© FILM THE PICTORIAL CONTENT 
OF THE LESSONS ACCORDING 
TO STORYBOARD OEf tgN 



PRODUCE SSmin NEGAtlVES 



1 



CREATE COMPUTER-BASED TEXT 
EDITING FILES ACCORDING TO 
STORYBOARD DESIGN — 
COMPLETE EDITING FOR LINE 

COUNT, SPELLING •tc. 



PRODUCE PRINTOUT* I PAGE = 
1 FRAME 



STRIP-UP VERSION I -- 
PROGRESStVE SEQUENCE- 
BASED ON 3S«in 
TRANSPARENCY INPUT 



COMPOSITE MASTER FOR 
2^ RfiOUCTION . . 



@ PASTE-UP VERSION U 
FULL FRAME FORMAT 
BASED ON 2.5" X 3" 
(XJLOR PRINTS 



COPYBOARO MASTER 
FOR 5X REDUCTION 



1- 



I 



— -r^ - 

® REDUCE MASTERS IN ONE 
STAGE TO MATCH COM 
SPECIFICATION (COPY CAMERA) 



PRODUCE FICHE MASTERS 



. REGISTER 
PICTURES AND 
TEXT 



DUAL FICHE 



REFORMAT Tl 
TO COM REQ 
FORMAT REQU 


1 

iXT'ACCORDING 
UIREMENTS AND 
IIREMENTS 


PREPARE COMPUTER BACKUP 
TAPE FOR COM PROOUCTlOfi 
OF TEXT 


• : 


r 



Figure 5 



needed and §p€cfh"c*TO information related to making a tip for a solder- 
ing iron follow in the same column. Column 4 starts with a picture of 
the . completed tip and continues with detailed information on how to 
achieve those results (tffe performance column). The next objective » 
making a tinned soldering tip, is pictured in column 4, ^nd the steps 
necessary to tin a. soldering tip are presented in the remainder of the 
column. This pattern of columns deyoted to introduction, TO information 
related .to performance, and then performance, was repeated throughout 
th^ four fiche and n\ne lesions required |1n the block. 

These formatting rules w%re captured on a detailed "story-board," 
which was used to direct the photographic? work^needed for the illustra- 
tions (step 2) and to input the text related to these illustrations into 
a computer file (2A). The edii^g file Vor each fiche was set up so that 
text cchjld be placed tn "fileWodules" that corresponded to each frame 
on a 24X microfiche^ i.e., a 63 frame matrix of nine columns and seven 
rows. I,t should be emphasized that the content of the lessons, includ- 
ing text, pictures, and lin^ drawings, was taken from the Illustrated 
Texts and the/TO, respectively. Bdth the development of the story-board 
and the filming 'done to obtain new negatives for the color fiche con- 
version were closely coordinated with school personnel ' 

The next f.tep in the cycle was to prepare the two master versions 
of the lessons, artd Figures 6 and 7 show the basic differences in the ■ 
^)roductipn techniques used. One significant difference in the two 
versions, from a cost perspective, is that Version I, Progressive Se- 
•quence uses ^5mm transparencies as the ioput for stripping up a compos- 
ite master, while thejiii 11 ^rame' version uses color prints (2 1/2 by 3 
inch) to assemble theWaster. The major cost factor is that of making 
the prints for the Full Frame version; otherwise tha costs are com- 
parable. 

♦ . - ' 

Technically, it would be-possible to photograph all illustrations 
using slide film and obtain the necessary input for Version 1^. In this 
way, oi\e generation in photographic reproduction is eliminated\, but at a 
price because the original photographs must be carefully controlled for 
uniform exposure from image ^o image. This is the principal value of 
producing an original negative,- i.e., the exposure can be controlled 
for, -either in printing the 2 1/2 by 3 inch (62.6 by 75.2mm) Positives 
or 1n printing transparencies having different densities,;, and selecting 
aaong the prints for the best exposure. 1 
,* . . • -/ ' 

Step 4 was straightforward. The composite masters were/relduced to 
m^ke distribution copies .of the 'color fiche directly. A fic\rk raas.ter 
could have been maofe if a large number of copies were required. The 
significant thiiig about step 5' is, that the film system used wis EKTA- 
CHROME professionaVfilra (Tungsten 50) developed with E-6 processing.* 
The film has a resolution of more than XOO lines/mm when cSrefull'y 
processed; and when used in conjunction with a high quality,] 



color- 



*^-6 processing of large transparencies is routinely done tw local 
laboratories on a custom basis. The requirements for producing and 
processing large nu^ers of dupHcates would require cus-tom ^quipinent if 
undertaken by a local laboratory or an Air Force production agency. 

■ . • . I 



COMPONENTS FOR TrtE STRrPUP OF VERSION I - PROOllESSiyE SEQUENCE 



OPACWE WIHOOWS OH LETTERIN6 ON 
■ A TR^PARENT BACKGROUND 



OPAOUE MASK WtTH 
35m«T«ANSfARENClE8 

PLACED IN THE PROGI^SSIVE 
SEQUENCE FORMAT 




2 X COLUMN GUIDE: 

OPAQUE LINE ON TRANSPARENT 

DIFFUSE BACKGROUND 
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.SECOND 




TWO EXPOSURES NEEDED TO CREATE MASTER FICHE 
* FIRST EXPOSURE CLEARS THE FICHE BACKGROUND 
. WHILE LEAVING THE IMAGE AREAS UNEXPOSED. 
SECOND EXPOSURE PRINTS THE 35mm 
TRANSPARENCIES IN THE PREVKJUSLY UNEXPOSED 
Af^S. 



r 



Figure 6 r-, ^ 
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COPYBOARO COMPOKENTS FOR VERSION n - FULL FRAME 



BLOWUP OF DETAILS 



RESERVED AREA 
FOR TEXT 



ASSEMBLE PRE FORMED 

COLUMNS ON COPYBOARO -y SSI^lt *^ 

NEEDED 



7 
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■^TAPE EDGES TO MAKE 
COLUMN GUIDES 



COPYBOARD ASSEMBLY FOR 5X REDUCTION 
{ONE STEP) 



. Figure 7^ 
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corr^iHd Tens, It : produces excellent image quality if the image reduc- 

, tibn ,^tteapted does not exceed a factor of five. 

r ..f^v- • • ■ » . • 

^ The reforaiattlng of the text (step 5) was accomplished by position- 
ing the text fields .within each computer' file module (a file module - 
one fraae on the COM fiche) so that the fields corresponded with the 
placeoent of the illustrations on each composite master. Typically, 
this ffleant using the editing capability in the-qspiputer' s Source Program 
Editor to awve blt)cks of text froip one 11 d6 of the frame to the other, ^ 
to nave text fro« frame to frame, and to generally tailor the text 
coaponent so that It was visifelly related to the appropriate illustra- 
trons. When the text reformatting was completed and' verified by com- 
paring the c£«tt)uter printout with each composite mastei^' a magnetic tape 
(printer tsc^up tape) was '*de, and . a microfiche master, was prodcfced 
fr<» thetape'by a local COM service bureau. \ 

Ih order to coB^lete the sets of Dual -Fiche needed for cj^assroom- 
trials, positive copies of the COM microfiche master were attached to 
the color tr^insparencies by double-sided" adhesivje tape. The t§pe was 
place<r at the top edge of the fiche so that it dfid.not interferg^with 
e»uls1on-to-e«ul si on contact between the two fiche in the body of the 
' ' tnfonatjon'&rea. After attaching the toM'Iche. the coB&ination waS 
- trlaaed and sets of'four were assembled as^owTi In Figtire, 8. 

Integration of Text-and Vi&uals / ^ 

The development of the two versions of thfe Block 14 materials was 
driven by the fact that there are many different ways to- approach the 
'prpblem of Intiegratlng text and'^suals on microfiche, and there are no 
criteria present]^, avAll able that would help guide this work. In ex- 
amining the pt^'blem closely, however, there appeared be two basic 
amH^oaches*, Either the text i§ a part of the frame, overlaid in a 
— quiet'' portion of the IllustratHon (as was done in the Full Ffame 
. approash)> or .the* illustration 1s"dkplayed as a "fnam^" within the 
larger display, area and' the .text placedvi^n close proximity so that both 
are displayed together. The problem ariseSs because the f:«miliar printed 
page Is -not being used as the input to the^fliicrofiche, as is the case 
:when, ftfr example, a document is filmed with a step-and-repe"at micro- 
' fiche camera. . ^ ' . ' 

At the-fi«k' of overstatement, the problem arose here because the 
jBicrdiflche is, being developed as an instruqticyial medium,, capable of 
> dellvefing both text and color wsuals; it is', not being used as a sub- 
stitute -for hafdco^y documentation. WHeh each of the basic approaches 
. was examined in flight of the w a student might be expected to use or 
process the Information contents of the lesspns. It was realized that 
^ the w«y the text and visuals were integrated might support or hinder 
X use This possibility arises from the fact that only one frame or image' 
■ -area can be displayed when the microfiche is projected. The frame-by- 
fraae presentation that results can impose an artificial ^hierarchy on 
the 1n.fop«at1on presented; that is, ■ main Ideas and subordinate ideas in 
the^jesson content tend to be treated at the same level. And- thq*level 
Is dictated only by the "space" or screen area needed to present the 
information. fWe problem 'may be best seen when there is -e ^eU^;io"shTp 
-between two or more ideas, as Js the .case in the lessons of Block 14^ 
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The actions (or ideas) called' for in the performance columns oftentimes 
were/related. When_ this occurs, it is desirable" to show the Velation- 
ship between these actions. . 

In Version* !, ProgrtesSiVe Sequence, this relationship was »g.ab- 
llshed by ensuring that two illustrations and their associated texlP%/ere 
always; on the screen. In the Full Frame version, a similar effect was 
achieved by coabining illustrations— one showing the overaT 1 idea or 
. geslalt and the other illustration "i^^set" in the same frame along witii 
'relevant text.. The subordinate illustration often supplied additional 
details, 'and this made it, practical to reproduce the detail at maximum 
size, consistent with the .inset area restrictions. 

' The one feati^-e of the fiche format that made ^hese approaches 
feasible was to organize the lesson elements by coljpn. The column 
provided the logical groupi ngs ;f or. different types of^ content, and in 
those columns where the integration of text and visuals was impoftant. 
I.e., the performance columns, the format provided the structure neces- 
sary to relate the performance information to the total lesson. 
■ V • ' 

The utility of these ' concepts has not been directly investigated 
nor haVe criteria been adequately developed to distinguish between their 
respective utilities. The classroom implementation -reported in the next 
section shows that students could react to the different versions and 
attempt to state the reasons for their preference. This question shou let 
be explored, however, if the microfilm is to reach ii»|potential as .an 
alternativ.e instruction medii^. ~ . W 

Block Test Development - ^ ^ 

The development of procedures for the production of block tests 
using COM was an important part of the overall effort. The main purpose 
-of -this development was to gain experience with the use of microf/che 
readers and COM-produced microfiche in the delivery of block tests. 
Since the AIS computer is already , used routinely to help develop the 
(Content for -block^ tests and to provide test scoring keys, it was essen- 
tial to determine if computfer-produced microfiche might also be an 
effective way to deliver the tests. If so, then the development and 
production functions for the tests could be. merged. The development of 
the Dual-Fiche concept ensured- that graphics could be merged with the 
CdM-produced text component using black and white or color film as 
appropriate. - i ' ' . 

Four block tests were prepared usjng the COM protiuction techniques 
described in' Appendix A'," a^d Q.ne ,test, aiock 7 Weapons Mechanic was 
evaluated in 4he school's Testing Center. . "S^^^^ ^hows the f c^e 
packaging used to. support this trial. Additional trials of, other block 
tests were not attempted because test revisions had occurred mi the 
interval between test preparation and imp^lementation (3 months;, ine 
results of this trial are reported if) the next section. 



IV. CLASSROOM EXPERIENCE WITH EXPERIMENTAL MICROFORMS ' 



. Two classrooiB trials were conducted^ In which the experimental 
Rlcroforms were routinely used by traihees in the Aircraft Armament 
SystoBs School located at Lowry AFB. The trial using the COM-produced 
block tests took place over a 3-week per4otf in October 1978 and the 
trial In which the Oual-Fiche were used in Block 14, Basic Soldering 
Techniques, took place over a 6-week period during Septeaber and October 
1978. The results obtained fro« these trials are described in this 
section; - , 

Block Tests 

The testing facility in the Aircraft Amanent Systems School was 
equipped with four Micro Design MINI COM microfiche readers , each having 
24X Mgnifi cation and gray screens. ^ Figure 9 shows the arrangement of 
the -equipnent at one of the testing "stations. During the trial period, 
102 students tpok the Block 7 test, and 40 of these students used .the 
COM licroflche-based test format on an ad hoc basis, as, a function of 
station availability and the supervisor's workload at the tine a student 
requested a Block 7 test. 

* A student, when assigned the microfiche tes^ format, v§s shown how 
to load microfiche into the reader and how to use the reader controls 
while at the supervisor's station. After this orientation, the student 
was given a microfiche (either positive or negative image polarity), a 
copy of the evaluation questionnaire, and' a copy of the instructions for 
taklfig bliqck tests (the latter required by regulation). The student was 
then dif*eCi«£l to one of the test stations, and no further assistance was 
given.% \ * 

Block 7 tests are avatlable in two versions, each with 20 ques- 
tions. A partictiTar version of -the test was preassigned to" the student 
based on AIS parameters. The questions in each version were composed of 
one- or two- sentence interrogatories and a list of four, possible answers 
(muHipl e-cnoi ce) . . The questions and answers were organize^ in columns, 
one column for each test .vjers ion. Further,- each que^th'^nVas formatted 
on the fiche so that only one questi on-and-answer array tould be dis- 
played at a time. "When the trial was begun,' it was ddter/i ned that one 
version of .the test should be obscured from the student' s view because a 
student who failed the test would be given second version after 
remediation. It was thought th it having only one version of the fiche 
would avoid potential compromise and perhaps confusion in the adminis- 
tration of the block tests. The necessary modifications to the micro- 
fiche were made simply by covering the appropriate column on the micro- 
fiche with an opaque strip of tape and doubling the nusber of fiche 
available for use in testing. 

Stod|nt responses were recorded on the Generalized AIS Test Forms 
routinely tin all block testing. A student, after comp1eting_thi 
block test, rH4ed out the microfiche evaluation questi onjiai*»e-,"had the 
test form scored tw machine (a feature of the,AlS>^'^nd^recei ved a copy 
of the test resurtsL, including. -a -pre^rTption for further training 
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(advanceaent or reuediation). At this point all test-related l^lterials 
were returned to the supervisor. All student actions, with the excep? 
tlon of coop^etlng the questionnaire and the use of microfiche idisplay 
Instead of a test booklet, -were routine— a routlRe established by stu- 
dent coapletion gt earlier block tests. 



Results 



The principal purpose for conducting the block test' trial- was to 
gai ft. experience with the' factors that Influence an effective microfiche-/ 
based test delivery syst^. These factjors were assumed to include!^ 
equivalent student performances, student acceptance (values), andad^' 
•1 n1 strati concerns.. The only hypothesis under test during this trjal 
was that there would be no difference In student scores on Block 7 tests 
•as ^ function of test delivery medl taa— Either the familiar booklet or' 
new microfiche. Table 2 shows the statistical summary related to this 
hypothesis. . The "f?' test performed, based on the separate estimate of 
variance observed, indicates that tbere was no statistically significant 
difference in student scores. 



TABLE 2. SUMMARY OF TEST SCORE COMPARISONS, BLOCK 7 TESTS 



Instruc- 
tional 
Mode 



' , Student 

Sample Size 



Mean • Standard Separate Vari ance Est 1 mate 
Scores Deviation T-Value OF One-Tail Prob.* 



Microfiche 40 
Booklet 62 



85.75 

.87.34 



V 13.85 
9.13 



-.64 61 



0.262 



"A one-tail test was made because there was ne reason to expect 
higher test scores on the microfiche 'system. , 



The microfiche evaluation questionnaire (see' Appendix. A) completed' 
by students using the microfiche system provided/ the basis for gauging 
student acceptance. The pVlncipal results and comments by students are 
summarized as follows: * 

0 • Most students (95 percent) had no prob terns using the micro- 
fiche' viewer. Two students had probTteras related to focus 
uniformity and eye strain. 

No student encountered problems with 'dust or fingerprints on 
fiche (25 used the negative polarity, 15 used the positive 
po i^i^y microfiche). 

Most |tudents (97 percent) focused the display format-jone 
question-at-a-time— satisfactory". Eighteen s Undents commented 
on the preference forthe format, i.e., It h«?ps avoid errors; 
Improves concentration; don't' lospe your place; helps in r6- 




25 



.?0 




viewing questions. One student responded 'th^t the format 
hinders your question review process. 

V o Suggestions for iaprovlng the systen ' noted by individual 
Students IncMed the addition of a "centering control; the 
Insertion of a "last question Barker;" the use of plastic 
covers" to protect the fiche; puling the platen "in," rather 
than "pulling it out," to advance froni question to question; 
the use of a reserved "border" 6t "area" on the fiche to avoid 
fingerprints on the Instructional content. 

* ■ ' ■ ■ ' ■' ' ' < ■ » 

o Co«i«nts on the systeia included: it was easy to use (N = 3); 

the systen is better than test booklets (N = 11); it is a 
"good feystew" (N = 9). 

0 The advantages noted included: no student markings on the 
fiche (N = 1); don't have to turn pages (N = 1); less space 
(N = 1); greater clarity (M = 4). ^ The disadvaritages noted 
0^- were: lack of faajiliarlty with systen (N = 1), ^nd the desir- 
' ability of viewing nore than one question at a time (N = 

o Four students made no co««ents beyond the yes— no respo 
called for In the questionnaire. . 
f . ■ . - ■ ' •■ • 

, It was clear froa an inspection of the questionnaires that student 
acceptance of the nicrofora-based blocic itest system is high. This 
conclusfon was also strongly supporfced by Supervisor feedback reporting 
"student attitudes and by the supervisors* insights into how the system 
could be 1«ple»ented Bore broadly- . 

Supervisor acceptance of the syste^i can be traced to- pi^^cticalcV- 
Drobl«»s in testing and test administration more generally. Ensuring 
that there are no marks on a test booklet is an exaiyle of practical 
probleis that may be solved by the microfiche system. The potential for 
routinely updating angl/or reconfiguring block tests on a regular feasis 
was seen as a need addressed by the ijiicrofiche system. The potential 
for using the microfiche 'to deliver an individualized test from a pool- 
of-test-1te«s was suggested* as a direction for further system develop- 
ment -(I.e., to aid in retesting, as well as> increasing the integrity of 
the testing process by^ avoiding test compromise). One target-of-oppor- 
tunlty identified fot^ ti^ . system was the delivery of the ia>d-teriD and 
final examinations by microfiche. Updating test items and simplifying 
retest procedures (i.e., selective retesting on specific instructional 
objectives) were thoughfto be important apfe>1cat1ons. 

Conclusions 

The block- test trial indicates' tj^t the COM-produced microfiche ^. 
have a place in the delivery and adroi/i strati on of block testing. It 
should be noted,. however, that furthe/ evaluation is needed before the 
practical limitations of the system /if any) Y%c°'"Plj5?Jy^""?^f,^^^^^^ . 
For /example, the Block 7 test is r#fatively short. Additional experi- 
ence irneeded with other tests that (a) are longer; (b) are nio re com- 
plex in subjea and visual content; and (c) require the student to use 



sChewatics, diagrams, TOs and manuals in conjunction with the microfiche 
.display. Based on experience to date» however, there' Is no reason to 
susp6<^ that a thoughtfully, designed system would npt enjoy student 
accieptance and »eet the acta.ini strati ve needs fqund in conputer-based 
instruHlonal testing applications. 

Perforwance-Qriented Instructional Trials 

The classroom used to teach Basic Soldering Techniques, Block 14, 
was equipped with four Micro Design 4000 Series Readers, two each of the 
4010 and 4020 models.- The different Biodels of readers were chosen to 
gain experience about iB§ge size-requirejRents; Model 4010 displayed 
iaages at three-quarter nornal si2e, "whija-^e Model 4020 displayed 
visages, particularly the text portion, at ^actual si-ze. Since the* work 
stations noc»aHy used for this training are designed for two students 
to work at a station, additional readers n^eVe not deployed in tBe class- 
rooas. As a result, students were assigned to the nicrofic**^ ifnits as 
the uni^s were available; otherwise' students Used the four volumes of 
Illustrated. Texts for their Instruction. This approach allOv^d the 
highly variable student flow in Block 14 to be accoiMBodated without > 
causing scheduling or workspace assignoent problems for the 1 nstructorsr* 
Figure 4-2 .shows the configuration of a work station with the reader in 
use by a trainee. During the trial period, 217 students completed 
Block 14, and 43 of these students completed the lessons using the 
nicrofiche system. " 

■ ' , • * 

One apparent disadvantage of thts , approach was that the trial 
period was lengthy, approximately 6 weeks. The length of the trial 
period actually worked to improve the information produced, however. 
For exafflf^le, four different instructors were assigned to Block 14 during 
the trial. This rotation caused three different instructor" teams/ to 
become »fa«1 liar with the microfiche system and its' characteristics. 
Further, the rotation helped to minimize- any instructor bias towards the 
microfiche system and helped to ensure that the trial was conductei 
within the constraints imposed by routine admini strati v€i requi regents 

^ A student assigned to the microfiche-based inistructiona]/ system, 
was given a film holder containing the four fiche, and the^rocedures 
for loading and unloading the fiche. . The use of the reader-controls was 
de«onstraf:ed for each student at t|ie work statiofj^-^njpon completion of 
the lessons in piock 14, the student was asked-^Ocomplete an evaluation 
questionnaire *^ part of the documentation normally required for coMrse 
continuation. . - 

Since the microfiche-based -instructional materials were assumed to . 
be self-explanatory-.-as Is the case with the Illustrated Texts normally 
used--the instrtfctor- student interactions centered around the critiques 
of student progress in preparing the nine mechanical and electrical 
components explained in the instructional materials. The fact that the 
«icrofich'e versions of the lessons routinely provided the guidance 
needed without involving the instructors in further explanations regard- 
ing the use of the microfiche, the location of Instructional content 
withifi a particular ai-firofiche, or new patterns j6$ Instruction because 
the microfiche systems w^ re in use, is both evidence of the -effective- 
ness of the system anW al coiaiient on the environment in which the trial 




' ■■• ■ ' .. . - " ■ . . ,^ 

took plac^. Stated another way, , if -^he fnicrQf|iche system of instruction 
I«rfouQd to 'require instructor injlerventioP^ during student us^. the, 
trial would have terwiriated. prematurely. j 



Results 



V « 



As in the Block Test' trial, the principal purpose of the classroom 
trial Was ^to gain experience wVth the Dual-Fiche concept for the del rv- 
e^v of colorHntensive. perforfflantre- related instruction. Because of the 
^^afr^nge":^^^^^^^^ involved. €he emphasis n this trial was 

glSIn to ^s^blishing a W to ^^."f P^tTdTf^^^^^^^ 

student acceotance -Student perfbrroahce was gauged along two different 
dSionsTc^^^^^^^^^^ t^m to Complete' the block, and (b) obseVvation of 
ihf pauerns in student use. of tKe mcroforni njaterials. Table 3 how 
the Statistical summary regardinn, block completion times. The F test or 



saiH^le variances showed that* the hypothesis 
accepted at the 8p percent confidence Tevel. 
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TABLE 3. ^ SUMMARY Of BLOCK 14 COMPLETION TIMES* 




Instruc- 
tional 
Mode 



licrofiche 



nius. 
Texts 



Student 
Saiaple Size 

35 
154 



Mean * . x- * 

Times Standard Pooled Variance Estimate 
fMinutes)Deviation T- Value DF iwo-TaTl Prob. 



806.97 4^0.95 



2.03 liB7' 



665.96 



360.77 



0.04i> 
/ 



*The'saga?fe size (189) does- not correspond to the 217 students that 
completed l?S?k ll due to missing data and the imposition of data relia. 
bility constraints. 



As say be seen by inspecting Table 3, the T test performed mdi . 
cates th^ the differences between completion times is significant at 
gf pLent co^^^^^^ F^^ther. there was no evidence to suggest 

tLf the student populations froiti which the samples were taken was 
Sff ferent: ' th^^^^^^^^ of sample variances ^f or the^ student ^gro^^^^^ P - 
J T c OQ i&A = 1 '^0 and none of the AIS Placement lesi. 

s-«re'c<^aHsons suggest populatlbn differences, even at the 20 percent 
leSel orsign""canc6^ "OneVeason for the observed difference in con,- 

L^ir thoudht to be due to the inclusion of information from the 
?Jf af a regSlar Jart of each lesson. Classroom observations Indicated 
students using the regular Illustrated Texts seldom referred to 
J^renc^d TO inf oration once the pattern of Instructor approvals for 
s?udert worlc was established in the routine of trainee Other 

ll^anl for the differente in completion time are related to the stu 
Serts" lack of fliliarity with the microfiche reader and the fiche 



forsat^, the fact tHat the student had to discover efficient patterns 
for using the f1che presentation, and the absence of tliue constraints 
characteristic of self-paced instruction. 

Other factors contributed to the large variation in completion 
tioes observed. First, each Instructor has -his own set of norms for 
gauging the adequacy of the students' work. Differences in the norms 
resulted In very different "standards of acceptable |tudent performance" 
betng applied during student critiques. These differen^rgs were observed 
to double the student time required for completion of Block 14 objec- 
tives. Second,, as, the student load Increased, the time for completion 
of an objective also. Increased due to the student queues- that formed' 
awaiting the Instructor's approval of the students' work. Neither of 
the factors, however, is thought to have affected the students using the 
Bicrofi Che in some preferential fashion. - - , « 

Student acceptance Of the system was also gauged by questionnaires.' 
Two versions of the same questionnaire were used (see Appendix A) be- 
cause only the Progressive Sequence microfiche format was used during 
the first 3 weeks of the trial and the Full Frame format was not Intror 
duced until th6 last 3 weeks of the trial. During the latter period, 
students used, both formats while completing the block of instruction. 
The two forwats and concepts involved in their development have been 
described \n the previous section. The principal results and student 
coBwents are summarized below: ' , 

^ ' - * 

Most of the students (86 percent) found .that the lesson organ- 
ization on the microfiche was clear ^fter they had corapletect- 
the first two Wessons > (Fiche #1). Five students were not 
completely sure oT the lesson format at this state of use, and 
one student was confused. 

, ■■ . ■ . ■ * 

Fou^; students had problems using the reader or changing the 
fiche iwindow 9* are, upside-down fiche*, poor focus). Most 
studentfe (90 percent) stated t|»at they had no problems and' 15 
of these students commented on the ease of use. 

Even though the classroom was a "severe environment" for the 
use of film ^af)d 'precision reader -equipment (becai*e of the 
soldering operations undertaken in conjunction wtthjilcroflche 
use), most students (84 percent) felt that dirrimd dusi^ on 
the microfiche were not a problem. Five students commented 'on 
the presence of foreign material, but. felt that it "(^idn't 
make any difference." Two students wer^e a*nnoyed fey its pres- 
ence. These results were surprising, considering that the 
positive polarity of the microfiche made any foreign matter 
highly visible and the Yact^ that each's.et of microfiche was 
used by an average of five students. 

The value of including "the TO Information as -a part, of each 
lesson was also recognized by most students , (81 percent). 
Three Students indicated that it was not helpful , sind-^lve 
'students found it helpful only to a degree. -Observatyns of 
student use patterns indicated that the TO informatrln was 
carefully reviewed, during the first three to five lessons. 



After it became clear that instructor approvals of student 
wor^dld not depend directly on- TO information, students began 
to skip over TO material^, 

0 ' there were «iany- cos«»ents on the adequacy 0^ 

in the test portion of the materials. Sixteen stua^^^ 
(37 percent) felt that the size was too smal -eight students 
sudgS that it should be larger, but that it was not criti- 
suggesLea percent) felt that the^ype-size was no 

p?LS/ It did not appear to matter which reader was being 
SsS tW 3/4 sue or the full size. Approximately o^^^^ 
of the students in both groups cdnpiented, oji the type size, 
i.e. , it could or should be larper. 

0 These results are consistent with the fact that the. raicrof^^^ 
reader was often used beyond the normal ^?^J"S distance of , 

li to 16 iHlhes.. because of the 5^^°:^^!?"^:;^,^^!^^^ '^'a^^ 
were accomolished while the reader display was viewed, ^s an 
■ ^dSltionaTciiBent on the text size, ^^^t 

that the students preferred to' use the hi gh-oagnfi cation 
Dr^iectlon lenses aval lab both models of the wicrofiche 
?I^def These lljlses displayed the fiche content at approxi- 

Visual acuity of /students-contact lenses, glasses, etc. 

- 0 Students that attempted to specify ^vantages _ana disadvan- 
taaes of the microfiche system vhen compared with ^heir exper 
ienci with the Illustrated Text tended to 
fflo^es of delivery when advantages were named and they 
to identify problems they encountered with the roicroficne wnen 
they considered ttie disadvantages. For example: ■ 

— vou don't lose your place (N=3) „ • . . 

-the iJ^formation is big enough to look at and work too (N-3) 
. - . > —more interesting— less tiring (N=3) 
—easier to find information (N=3) 

■ , ::JSlnT%Toirip &h the pages to find s 

—easier access to lessons (N=l) " 
■^-quicker, less space, more compact (N-9) 
—pictures are clearer (H=7) 

—less mney (N=l) - . . 

—in frpr>t of you— stares you in the eye (N-Z) 

^ —easier to read (N=4) . ' 

— not as quick (N=2) ^ 
—pictures not clear enough— blurry (N-b; 
* —reader takes up tpo much space (N=3) ' - ^ 

—cannot take it home (N=7) 
—hard to keep clean (N=3) 
—focus (N=2) 
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During the later portion of the trial, students usecf microfiche 
sets* that were made up of both versions of the Block 14 lessons, two 
fiche In a set (either the first two or the last two fiche) were Ver- 
sion I-.-ProgressTve Sequence, and two fiche .were formatted according to 
Version II— Full Fraiws. The objective of combining the two* versions in 
.a set was to aake.1t possible for students to report their preference 
for a particular version and to cowaent on why that version was pre- 
ferred. Twenty-three students were Involved in this phase of the trial. 
The 21 students using the system during > the first phase of the trial 
worked with only Version I"Progress1ve Sequence. ' 

Approximately one-fourth of the students (26 percent) attempted to 
articulate relative advatitages of each version and identified advantages 
tjfpboth; one-third -of the students -(35 percent) preferred Version I, 
while thr«e students (13 percent) preferred the Full Frame Version. The 
rest of the students (26 percent) either found no difference between 
versions or made no attempt to comment. The significance in these 
results lies In the fact that the two different fiche formattlBg prin- 
ciples were recognized by 74 percent of the students and that, their 
Indications of a preference confirmed the reality of the basic problem 
addressed during this project, .I.e. , how to mosf effectively Integrate 
text with visual content on microfiche. As discussed previously, the 
wain difference between the two-versions of the microfiche concerned the 
way a balance was struck between t|je te^t> and pictorial content of the 
microfiche. The text was identfcal* and the total number of illustra- 
tions presented was essentially the same for each version: only tjie 
relationship between text and illustrations changed. The students ' 
sensitivity to these Issues can be gauged from Table 4 where four stu- 
dent responses , representing the four categories of preference noted 
above, have been tabulated. Student responses to the other questions 
have been included td provide insight into each student's experience. 

Conclusions ' 

the results of the BlocK 14 Trial 'should be analyzed from several 
different viewpoints. First, m is clear that the Dual -Fiche concept is 
a practical one. Refinements such as employing a clear, disposable 
envelope for registering the two fiche and protecting the film represent 
logical improvements in the instructional materials. Second, the bulk 
of the problems encountered during student use can be solved through 
careful and systematic implementation. Such things as window glare, 
type- size, machine performance (focus, bulk, screen size, etc.), work 
space, student orientation, film handling, and so on, can be addressed 
In a comprehensive system design. Third, the need for an update capa- 
bility, as is represented by the Dual -Fiche, was- reinforced. The in- 
structors had strong (and highly personalized) views about the adequacy 
of the instructional content of both the microfiche and the illustrated 
text. Fourth , the microfiche can be used to deliver color-based, visual- 
ly Intensive Instruction within a performance- oriented environment. 
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< TABLE 4. REPRESENTATIVE RESPONSES TO- THE 
QUESTION OF MICRgFJ CHE FORMAT AND OTHER COMMENTS 




Question: (A, 6, etc., identify the responses of a particular 
student to each question.) 

0 Did you notice that the first two microfiche you used were differ- 
ent froBJ the last two microfiche? We made two versions of the les- 
sons and we need to know iftyou think one version is better than 
the other. 

The version (Full" Frame) with the pictures that filled the 
* screen was better because: 

A— It .gave' a little more detail on the object I- was sol- 

" V. dering. 

• g«- . ' ^ 

* ■ C— It showed more than words, it really helped. 

• ' D— Noted no difference. * 

• The version (Progressive Sequence) with the text beside each 
picture was better because: • 

A— You could reference back to the paragraph to do. the 
work more efficiently. 
* * B~ It explained morX clearly, the text helped clarify^ the 

• picture. 

D— Noted no diffet^ence. ) 

0 After you had completed lessoi? 1 and 2, was the way the Ife^sons 
^ were organized on the film clean, to you? 

' ** , ' \ - '"" 

A— Yes, I caught on aft^ tfr§ second column on the first 
' . fiche. 

B"Yes. 

« C— Yes, they were very easy to learn. r 

Q— j^e first few lessons were easier to understand than 
later lessons. ^ 

0 Did you have any problems in using the reader or changing the micro- 
fiche? 

/ A— No, none all (small model reader). 

8— It was hard to read at times (small reader). 
Q—Ho^ H was a very simple operation (large reader). 
D--Got It upside-down most of the time. 
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TABLE 4. , REPRESfNTATIVE RESPONSES TO THE 
QUESTION OF MICROFICHE FORMAT AND OTHER COMMENTS (CONT. ) 



0 Was dust oi^ dirt on the microfiche a problea? 

A— No, It was hardly notlceabTe. 

B-No, • 

C--No, It was very clear. 

O'-There was no dust or dirt at all. 

/TT- • Was the presence of the TO Infonnation on the film helpful to you? 

A— Yes, it explained in detail what I was seeing on the 
filjB. 

B— Yes. >> • 

. C-Yes. 

D—Ves, ffluch easier than going to the (Actual) TO 

0 » Should the type-size of the text be made larger? 

A— It all depends on the person, I think; but personally 

I don't think so. 
B~Yes, .a little. ' 
C"No, they are just the right ^e. 
Dr-No, it was easy to read. 



r' 



0 'Would you coflHiare using the microfiche system to using Illustrated 
Texts? ' " $' \ 

*• Advantages: . / 

' . ' A— A lot more' interesting than using a book. 

B"Easier, to learn by— less tiring. ' 
C— It took up less space, roore convenient. N - 
D~The illustrations are larger and it is easier to see 
what is going on. ' 

Disadvantages:. ' ' 

^s^— You have to focus durlHg your lesson. 
'"B\Harder to read. ^ 
C~Xcouldn*t ffnd any. 1 
0— Scwetiflie's the pictures seem to be blurred. I 

Pleas^sake any suggestions that you think would iraproye the njicro-'^ 
fiche system. 

A— A self- focusing lens and mechanized way of movii^^the,' 
• fill would help a lat. ' ' ./ 



TABLE 4. REPRESENTATIVE RESPONSES TO THE 
QUESTION OF MICROFICHE FORMAT AND OTHER COMMENTS (CONT. ) 



B— At tines the machine was hard- to read. On side of the 
screen was in/ focus while the other side was not. The 
nachihe is leiss fatiguing especially in the early morn- 
' ing hours. But the sun glare is a major drawback in 
reading the machine. 
C— More of a detailed description of the subject matter 

would be helpful. 
D— A better system to/^ile the films. Have a title on 
them so you know v^ch one to go to. 
0- 4^' 
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V. RECOMMENDATIONS 



' .. . 

The recoaiReodations presented In this section are strongly influ- 
enced by the favorable cost-of-production picture associated with the 
Dual-Fiche concept. Table 5 has been developed to giv^ an eleujentary 
picture of the production costs for the two versions of the "Dual-Fiche. 
,As a point of reference, the AIS production cost experience fo^* prenar- 
rated fil»s trips is also presented. ' , * 

The assujnptions made in developing the comparison* are .that: 

25 copies of the nodule are produced. ^ 

The costs of preparing the script, storyboard, and -obtaining 
ZSm exposures of iljustrat ions and flat art (total person- 
hours/hour of instruction) are the same. 

The costs of capital equipment— cameras, audio reproduction 
equipment, th^ computer and computer terminal --are not allo- 
cated. 

\ . ^ 

■■ \ . ^ 

Each frame of visual Information has audio or text associated 
with it. * - 

The table shows how the marginal costs accrue when the nuiaber of 
images, with either text, or audio narration, is increased from 25 images 
to 75 images per module. The maximum number of visuals that can be 
expected on h single fiche is approximately 100. The formatting of the 
fiche by column indicates that the film capacity will, be underutilized. 
For purposes of the comparison, it has been assumed that the color- fiche 
would have a maximum of 75 frames' or images^ The marginal cost patterns' 
are shown in Figure 's. -The table also pr^ldes a basis for estimating 
the costs of updating text and audio, assi^ng that the visual component 
is revised and that the updating makes small bul 'important changes. It 
alsfo demonstrates the* potential for updating the^Vlsual component alone. 

■ Updating the audio component of a filmstfip, assuming that" the 
cassettes are reused, involves labor, costs primarily, and these costs 
are estimated kt $9.00 for 25 frame lesson? and $18.00 for 75 fraipes. 
The cost to update the text in either version vi^ COM is also abdut 
$9.00 for 25 frames, but it is- the Stame for 7S frames. To update the . 
visual cofflpoinent, 25 frames- of filpstrip .(assuming A&B roll printirtg 
with the updated frames on the B roll) would cost .approximately $25.00 
for 25 frames and approximately tSO.OO for 75 frspe modules. The color 
fiche could be updated for approximately $60.00; again the cost is 
essentially independent of the number of frames^ "in the module. In 
considering the implications of these comparisons, it is: important to 
note that the cost of the color fiche component has been estimated at 
_|2.00 per copy. This cost could decrease" sliarply, i.e.. to $1.25 range, 
'f a system for duplicating masters were assumed. " . 
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TASLE 5. PRaXiJTipH COST COMPARISON FOR OUAl-FICHE VERSIWiS: 
AIS PROOUCXICSi C0STS FOR FILMSTRIPS IMCLUDED FOR REFERENCE 



Version II^-Fun Frame" 
25 Frames 



Cost Categories 



Processing Original negative 
Enlarglifjg to 2.5** x 3*^ 
E!)Urging to 6" x S" 
Filastrip Master' Neg. 

$S.OO/Kr Labor • ^ 

Iritemegatlve Processffig 
3 tlensity Prints 
Kotalith Masks & Pr|?cess1rig 
Strip-up and Paste-up 

Ektachrowe Prints & Processing 

,$6.00/hr Labor 
FiliBStrlp Print . ' 

Audio Reconfing (total) Labor 
Lafjeling & Padcagjng Labor 
Packaging and Cassettes ' 
Fiche Refomatiln Lai 

COH Back-up lak^ S Dian 
CW Master Fitfhe 
COM Duplicates 
Cowputer Tinie 9 $700/hr 

Cost Estimates for 25 Copies 




Prenarrated Fil.mstrTp" 



2S Frames 75 -Fraaes" 



3 ft 8 $0.30-0.^ $ 2.70 



$2S @ $3.00-75.00 
3 ft ■§ $0.10-0.30 
i/4 hr/2S Fraaes- 

$1.50 
3 ft 9 $0.30-0.90, 
3 ft 9 $0.15-0.45 



75 ft 9 $0.30- 
$22.50 

2 hr/25 F-6.00 
50 units/hr-3.00 

$l.Ci0/unit-25.S0 



$135/25 F 



$225.00 

$ .90 

$ 4.50 
$ 2.70 
$ 1.35 



$ 67.50 
$ 18.00 
$ • 3.00 
$ 26.50 



Version I --Prog. Sequence 
25 Fratnes 75 Fraines 



$349/75 F 



3 f t e $0.30-0.90 $ 2.W 



3 ft § $0.15-0.45 
2 9 $1.00-2.00 
2 hr/25 Frames= 
$12.00 V- 
25 9 $2.00-50.00 
25 Fiche/hr-6.00 



$0.iO/unit-2.50 , 
1 hr/25 images- 
$6.00 

$1.00/63 F-1.00 
$0.85/Master-1.85 
25 F 0 $0.15-3.75 
^tiinate$ip.00 

'$97/25 F 



$ 
$ 



1.35 

2.00 



$ 36.00 

$ 50.00 
$ 6.00 



75 Frames 



3 ft & $0.30-0.90' 
$25 0 $1.50-37.50 



$ 
$ 
$ 
$ 

...$ 



2.5P 

18.0(5^ 

1.00 

1.85 

3.75 
30.00 



$155/75 F 



2 Hr/25 Frames- 
$12.00 - • 
25 § $2.00-50.00 
50 Fiche/hr-3.00 



$128/25 F 



$ 2.70 
$112.50 



$ 36.00 
$ 50.00 
$ 3.00 



$0.10Ajnit»2.5O 
1 hr/25 images" 
$6.00 - $ 

$l.J30/ 63 f-1.00 $ 
$0.85/Master-1.85/ $ 
25 F 0 $0.15-3^.> 
Estimate $iAf^ $ 



2.50 

18.00 
1.00 
1.85 
3.75- 

30.00 



$251/75 F 




^ . COST OF-^OUCTION ^ 

. Figure li; Marginal Cost Patterns— Dual -FichQ VS Filrostrip 



Recownenctations ' 

The Dual-Flche developTOnt reportecf here is believed to have great 
potential, inr Beeting the multiple objectives inherent in instructional 
technology development. There are good reasons to believe that it can 
be a cost-effective alCerna'tive for ^lelivery of visually intenMve 
instructional nodules and that it would enjoy broad student acceptance 
It is an -alternative to the familiar AV media when the rouUimedia re- 
quirement is not essential to the instructional strategy ewployed. 
■* ■ ' , ^ , 

In terms of the AIS 'environment at Lowry AFB» or other environments 
in which computier-based instruction is being applied, the Oual-Fiche 
concept is particularly significantr 

' • " , -it • . . 

. 1- ' The concept ensures that "updating capability" is an inherent 
feature of roicrofiche-oased instruction. 

2. ' It ensures that color-intensive instruction can be delivered 

through the microfiche medium as well as other types of in- 
structional materials. 

3. It ensures tMt the production ca|jab^ility_^ian^ -'^t^^ 

^ to the course developers and Air Force production agency. 

The principal recommendation is to develop tie concept further. 
This development should take .place in an instruct iQnan environment in 
which the , refinement of techniques for producing^ tRe microfiche can 



proceed at the same time* that a system, to support large scale use is 
established. By developing and evaluating instructional moduUswhile 
bunding the capability, In terms of equipment and skilled jJf^s to 
^produce. modify, and update the modules, it will be poss^ible to build^ 
the base Of experience needed to foster routine use of micrqforms. ' 

The starting point Yor implementing -the -reconmiendation m^ight be to 
select a course of inUruction, perhaps not a current AIS course, in 
which the updating of instructional modules is an urgent and recurring 
profalem. for certain .blocks of instruction in the course, instructional 
Baterlals (modules) would . be developed using the AIS $ystero, and the 
capability of an Air Force production agency. As these materials are 
evaluated (H would be desirable to Incorporate the AIS testing capa- 
'bility as a part of the evaluatton system), updated materials would be 
introduced on a regular basis, and these 'materials would also incorpo- 
rate tbe isprdveftents identified by the evaluation process. -Such an 
enyironaent woUld act as a test bed to resolve conceptual and technical 
lisue^, and a^ prafctical results^ are demonstrated, the capability would 
bte present to extend ttie proven applications to other blocks and u J ti- 
( mately to other courses driven by the Inherent need to modify or update 
>^course materials. - . 
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APPENDIX A 

QUESTIONNAIRES USED FOR 
IMPLEMENTATION FEEDBACK 
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Microfiche Evaluation Quistionniare . „ ; 
(For UsI by the Denver Research Institute, University of Denver*) 

■■■■ ■ • ■ ■ •■ -V vl 

You have been using coajputer-genefat^^^ microfiche to^pres^ 
Block test questions. We need your heTp;i ft evaluating ,thi^^ nncroT 
viewer syste«. Please complete this questifrt^aire. | 



1. Your Social Security Number 



your 
iiche- 



2. Which Block^S^t did you complete\s4ng tbe laic^ofiche? ^ / 

3. Did you. hive Jiny problems using the^roi^f^ffche or ^he viewer? _ , 

Coaaents • : ^ • — ■ ^ 

4. bid dust or fingerprints on the microfiche cause problem 

Cawients . ' ' — — ^ — — - — 

♦ . ■ 

5. The Block Test questions were shown one- at- a- time on the viewer 
screefT. Was this arrangement satisfactory to you? _ _ 




CoMents 



6 The microfiche can be made with either black print on a light back- 
. g?^Mnd; or white print on a dark background, Which type did you 
use? ' 



tight background ■ Dark background 



7. ' P-lease^iRake any suggestions you think would improve tjie raicrofiche 



system. , L ■ 



I' 



Thank you for your help in this ^valuation. 
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fc u ■ Evaluation of ^the Microfiche System' 

(For Use by the Denver Research Institute, University of Denver) ' 

0 Walt for these Instructions." * ^ 

° Jl«ays handle t by their Mabels (at the 

top). (OTrt ^and fingerprints will impair, ijerformance. ) 

-0 Keep microfiche- holder on top of the reader except when 
changing microfiche". 

Sivf tM??^ work Station. -complete the questions below and 

tl tJiL^.tV' ^"^^T^i'-''-- Return the microfiche holder 

?»ni« • ""^JSr* ^^""^ coawef^s are very important for evaluating 

and improving this new /system. \ evaluating 

0 Your Social Security Number ' ■ . - '■ ^ 

0 Did you use a large reader or a small one ? 

0 . After you had completed lessons 1 & 2, was the way the 
lessons were organized on the film clear to you? 

Comments: 



Old you have any problems in using the reader or changing 
Comments: 



the micnofiche? 



Was dust or dirt on the microfiche a problem? 
Comments:' 



Was the presenqe'of the TO information pn the film helpful 



r 



Comments: 



0 ^Should the type^^ize of the text be made larger? 
Comments: 



.Would you xompare^using the ' microfiche system to us i no 
illustrated texts? ' . • 

Advantages: _^ ■ 

Disadvantages: ^ 



Please make any suggestl9ns that you think would Imprgve 
the BJicrofiche systaaj. 




nid vou- notice that the first two microfiche you used 
SeredTfferent from the last two »icrofiche| We made two 
ve?!ions of the lessons and we need to kiww if you think 
one version is better than the other. 

The version with the pictures that filled the screen was 



better because 



The version with the text beside each picture was better 
bftcause ^ , — • ' : 



Thank you for your help in the evaluation. 
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